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Publication No. 2000-270203 

[0031] <Camera Inside Parameter> A camera inside parameter is a 
parameter specific to the image pick-up section 10, and more specifically, 
may be the focal point distance of the lens, the size of the CCD and lens 
distortion, for example. The zoom work also can be this parameter. 
Since the camera inside parameter is uniquely determined by the image 
pick-up section 10, the attachment section 14 may have the camera inside 
parameter as data beforehand. With this camera inside parameter, it 
becomes possible to set the pass parameter (perspective projection 
distortion) of the CG image in agreement with the real image when 
combining the CG image with the real image. 
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(54) IMAGE PICKUP DEVICE, IMAGE COMPOSITE DEVICE AND rTS METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To obtain a composite 
image with high reality by automatically generating a 
composite image between an actually photographed 
image and a computer graphics CG image. 
SOLUTION: An image pickup section 10 photographs an 
actually photographed image. Furthermore, an 
environment parameter acquisition section 12 acquires 
an environment parameter denoting a photographing 
environment, an attachment section 14 adds the 
environment parameter to the actually photographed 
image and stores the result. The environment parameter 
uses a light source parameter and a camera work 
parameter or the like. In the case of image composite 
the environment parameter attached to the actually 
photographed image is read, a CG image is generated 
and composited with the actually photographed image. 
Thus, a shadow similar to that included in the actually 
photographed image can easily be attached to the CG 
image and an image with high reality can be generated. 
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UCGMfe£^fiE1-&*&£t::, H¥ffilM>C*J^-CBF« 

w^tices LrwtnmTtfmt LT <> , #?JgO 3 & 

7cf2:E7i«BEftir-A*fc«!>, ^5t$ft*CGin£fc;:eo^ 
ffia&r uruf-r & c 1 a f T £ * 0 

[0 0 5 1 ] fcfc, &±TNiAfl*ftfciHlt»*^v* 
[0 0 5 2] <*^*7^-?>*^<0&'m£- (|»* 
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[0 0 5 3] <^/^^-^>^(^/N , 7>-^iC(i, 

cGwmzttLxmm%m&%£*5-z.z> 

ZtX\ j§ft\&<DZ\,*&iSLWiti!>mt>ii&o urn'*?* 

mjummtt* me«\ sunt, 
[0054] >wm i o xwmfc 

L fei^ffl uHi* * ' * 7 * - * Tab ») , »fSB#**¥- 

^^llft^^-f *lgiC3^3I^Ijf££ffl^T Li 

Afc*<*e*H £^&£#;tTL£ 9C££^f£UK 
lhT£* 0 

[0 0 5 5] <iS«/<9^-^>H¥lifW f A»«:iR» 

[0 0 5 6] <7'OD-^/xfD-^7>-?>I 

(*ffftUft^») o **vw±. ^¥Uf^ f ^t5[^A^^± 
& £ T ^ 4 Wfc-e* * tR^, f&^ffltf L T v * * TOf «U 

^, <>*,%A,c:nc>^TS:ffl^^£.55»i*<, amz 

mSitiUXX^o LT, ftftOffil 4T*ii, «f«» 1 0 
®{f LfcM«»/<5 ^ - 9 «r#*DLTgaig^Suai* 

[0 0 5 7] Ell 0C(±, i?l(^^7 ^SP<7?7*- 

&%v%mz%mziu &izmt<r>i=7'>\,&^ -t%t> 

^2^7C^3^7C^^^Syi-*/j^Otg^ f E®$n 

^>o -f* LT, B^f^^O^M>^t^ii/N-7>-^^ 
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[0058] mi n:ii, mi o{-fctt&i&ffHff&^<o 

*HfW#K #2, #3, ■ • •*&«Jft3iu 

row 

[0 0 5 9] HI 2U(i, Wftffi»Uf+iP$<i* 

tv»4, fc*5, iiA^^-^Lri^L^i/^ 10 

71*30^7 *<*7"7-*/< 
7*-$\ Htt^-fX/«7>-^, * 
5v^7>-*\ 7C^*7^-*, #/*7*-$\ fl##J/* 

4&<0/<y 9 _&&trZ 
tW^ZWliWlZXi**^ 01 2 izWr, ftft 
'<y jrf^ftfflS^? J<-?*<£aRUEB$h, 

£t::* j< 7 n-9>*y *-9'^<r>#< >?mWi&tt1}u2 

^ - ^S.C^i^/^7 ^ - 9 fr±m'*7 * - 9^<r>#>( y 20 
9 I £ , $ <b U ^/ < 7 - * -v<75 # -f > 9 K. im M * * 

-fo 9 vm^i-z z t i> *t&x-hz> 0 

[0 0 6 0] mi 3C(iHll 2\Zte\ihi} tm-t 
y *-9^(T)i£< > 9X-fife£il2>lJ jt 7 7-7/^7^ 

y*-9\u *-isa>*rs>h$k (mm) RIW 

lWte* (x, y, z) tfjj^MJt^? #2P,S#i 
* (x> y, z) £fj)£il®^? • ■ -frbm& 

Zi\Z>o *^77-^UEWE^*ii4t#^Z 30 

[0 0 6 1 ] iH UliU 1 2 Ufcv^T^/^7^-^ 

h«^itv^. «^7 ^sas^s- 

itWM\~ib\WStLW. (x> y, z) . 7fc?^7ic;X^7 h /K 

zzm^xvm-t* zttfx^Zo 40 

[0 0 6 2] (HI 5i:(±, m\ 2<r)^s*yS- 

9^<T)tf<< > 9 X'lifcZilk^'*? *-9<F>7 
J>«$iitv^ 0 «/<7>-*li, ^.&&t>'&^ 
ig£*>ffiB (x, y, z) , Mfev-7'>^, #?^fjj 
• ■ ■ *»(>lftjt?n4, «y-^>^lifoiMI 

[0 0 6 3] $HKt:^lt^imi li, &±<7) 
«t ^ U Lr^¥H^(cJSf^^^^-rfl^^*7 ^ - ? £ 

t^ufg (i^fflwifi) t LT^cGosm^^-r so 
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^GSCtt. i£H#g^6H¥®f$£BtfcaiU H¥Bf* 
i;»?iT.TV^ii;\'7 > - * SrffluT C GMH&£ i 

[0 0 6 4] Ell 6 C"ti. *%fffl|^UgCt*BBfrft 

M2 0l±, 8W^<7>~^}ftas»l 5. CGf&£«5 2 2 
&t>*£-/CT2 4 «r^-C«Jfi^n-6o 

[0065] mm^y * - ^fflffiffls 1 5 ii> lassie 

m^ihU m.fr&LtzWi%7*-9frhWk'*y *-9 7> 
-9*m&l,XCGftim2 2C^|&i"5 0 ^¥ 

[0 0 6 6] C GftfifcfflS 2 2 ti, ^rfaJOCG«tS«H6* 

1 5frbm&2ixtzmm'<y*-9&m^x^wi&<?> 

/n-7 > - 5^ U^gcL/c/^7 ^ - ^T'C G^p^f^i" 
AfNdlCli^ mjLlfm&'*7*-9+o>-%tts<5* 

- 9 ^ xmsmmz-s t n z> % z t m-<r)& * c g m 

[0 0 6 7] ^fiSc§P2 4(±, CGf«§Ti2 2t'M^^ 
>L- C G S15 q °d t W&' *y*-9 4ft£tiflS. 15^^ ^ 

/<7 > - ^ H^o'^t iMt:CGM$-M LTM 
-r^fiOT, mWdtHW/f? > - 9 S:ftSt:»RLfC 
GSRn^URIft^-**^!?^* < & 0 > 'J 7 U f -f 0^5^ 

[0 0 6 8] CG<tJSffl5 2 2 -CCG^JSfci-iU 

f^L, m&'*y *-9i&&U \ 5frbft&2i-Ltz%t8L'< 
y * - 9 C0£T $r #^ L T C G * «r 

SSUJo > - 9 (O^ < C G «■ 

[0 0 6 9] Szt:, (Dl 6^flMtU*3v»T«i, ^^^7 

^ - 9 tarn SB 157)^^^ n^mi/ < 7 > - ^ u^o- 

?t:C G®fft»cov»r*i, ^B#UfSgffl Ltzmt'<y * - 

9 tti>izr-9'<-z{zmMLx&£. mtzizn^w 

»P?iifclR^<7 > - 9 t&tiZ-t^n&WfeU&i ix 
X^&mm'ty *-* tZ&Ml^ CGUfg^^iELT 

mm.m-tz>zti>%7Lhi\z>o 

[ 0 0 7 0 ] dl 7 C<7)«£ -7 ^^^<75lHfij£7*n y 

Gliffef-^^-X3 2 3Wflv.tfe'Ji* 0 H^lifSUCG 
Bflfc«r#«t*»*, CGlif^-f-^^-^3 2(r«tt 
?iLTv^CGBffetiCGW?iE§I5 3 4 C^$n4 0 * 
LT, H¥Bffeumo$iirv»4SI%/<-7 > - ^ G 
ttjEffi3 4i:«L CG^iESr>3 4"C(±, CGliffeU 
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AZ^-fZ %^Wmz£j& ZiitzCG Uf£ a i)*&&t * 
b-t&o -^CGHfftat^TM^SWIMBlCfcjR 

> — ? B frffl^T C GUffc a ajgatta-fcffiE LT 
CGHftb^^^o -ntlJ: CGfcIEg|53 4 «±* % 

[0 0 7 1] £Lt, ^^HiJf^Cov^, JftUH 
[0 0 7 2] 

£ C Gilfft* tfa£-j£ffllif*«v<7 > - * *■ gf&tti::— 
[HMOfBf^^^] 

[m 1 ] ^%^^H*Sff^^lfif^M<Ofi|^7'n ^ 

[m 2 ] im> <r>wmix-& & 0 
im 3 ] ^ -9<vn&m\mx*hz>o 

[13 5] ^<7^-^<7)I*M7o-f t - h-cab 

[@6] (-eoi) -c& 

[iai] 




[17] 
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[tU7] *^7^-^WJHtiraH (-C-0 2) -c^ 

So 

[tH8] Ej4(Ii=ttS : g : Atl^(7)-^g]T^S 0 
I® 9 ] ^HfiS^®ic^(t*flb<o#/<7 > - 

m i o] ssifc/ < 7 * -ttHtmziifzmwwmr- 

[mil] nil 0{z&vzmmffiBft<ny*-^v 
io na-c*So 

[Hi 2] 111 0lz}siiZ>mM'*7*-?B<V7*- 

[HI 1 3] (21 1 2lZ*3lf2>iJ j< =7*7-5 J*=7 

[mi 4 J 01 2U*3tt&*?l/<7^-^SPO-7 + - 

[Ull 5] mi 2lZ&ltZ>^/*U-?tf><D7 

\m 1 6 ] ^Hifi^Sgt:*5»t-51iffe^Mw»dcy 
20 n y ?mx~hZ>o 

\m\7\ *%tmmtz&whw\&&j&&w<Dm<om 
i t&imm. io i©f£gi$> 12 zm^ys-tm 

f#«5, 14 ftflnSk 15 SRift'^-X-^Jfiasffi. 2 
0 Eft^t v 2 2 CGftdcSB, 2 4 ^dtfflS. 3 
0 H^OOfftr'- 3 2 CGUf^T'-^^- 
3 4 CG^iESBo 

fa) is 




300 



(b) 



I 

6 




300 




302 
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[fH 2 ] UD4] 
(a) 12 
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[mi 2] 



«mtM 



SI 3 J 



# 1 P*S*S/5(x.y.z) U^g^ MKdx.dy.dz) 



# 2P*fl*aj5(x.y.z) U^Jg^* SJKdx.dy.dz) 



CHI 5} 



# 1 WSiaBfty.z). 

lY " 



<ft£Ett1 6mm, CCD 1/3 -TV*. U>XiW 



B®7Tx7Tf7=5 (-/-rx«will».io) 



999.2. 22JST1 3:05:32) 



[(HI 4] 



# l ftSStffiEfty.z). 3E53fcX'<$ hik 



# 2 ftiRl&Sfty.zK hik 



15 



[mi 6] 



20 



22 



24 



[[317] 



30 





34 



"> CG(»iESP — 



^7 



32 



34 



7D> h^-->*<0$t£ 



(72)'5feWS *tt » 

*IRflWai|f3RIE*ji 2T§5f 5f E 



) 5B050 BA06 BA07 BA10 DAOl DAIO 
EA07 EA14 EA19 EA30 FAIO 
5C022 AB15 AB51 AB66 AB6S ACOO 

AC13 AC14 AC72 
5C076 AA13 AA40 BA06 
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